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This  paper  describes  steps  toward  the  recognition  of 
cultural  features  such  as  buildings  and  roads  on  aerial 
ohotographs.  The  approach  involves  several  successive  stage 
of  qrouping  of  edge  segments.  Straight  line  segments  are 
fitted  to  sets  of  edge  pixels;  compatibilities  between  pair 
of  these  segments,  based  on  gray  level  and  geometric  informa 
tion,  are  computed;  and  the  segment-  are  then  grouped  into 
building-like  and  road-like  groupings  based  on  these  compati 
bilities.  Examples  of  th».  results  obtained  using  this  ap  of 
proach  are  given,  and  some  variations  on  the  initial  stages 
the  process  are  also  investigated. 
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1 .  Introduction 

This  paper  describes  an  approach  to  the  extraction  of 
cultural  features  such  as  roads  and  buildings  from  aerial  photo¬ 
graphs.  The  approach  involves  three  stages,  at  which  succes¬ 
sively  more  global  knowledge  about  the  features  is  used  to  guide 
the  extraction  process. 

The  approach  taken  in  this  paper  was  motivated  by  the  fol¬ 
lowing  considerations : 

a)  It  is  necessary  to  develop  methods  that  can  deal  with 
cases  where  map  information,  giving  the  approximate  locations  of 
the  features  to  be  extracted,  is  unavailable. 

b)  An  effort  has  been  made  to  use  methods  that  can  be  im¬ 
plemented  by  parallel  processing  techniques,  particularly  at  the 
lower  levels.  If  inherently  sequential  methods,  such  as  road 
tracking,  are  used  too  extensively,  it  will  be  difficult  to 
implement  the  feature  extraction  process  in  real  time. 

c)  In  order  to  reduce  computational  costs,  the  approach  has 
been  broken  up  into  stages,  at  which  increasingly  global  and 
more  specialized  knowledge  about  the  features  to  be  extracted  is 
used.  The  first  stage  involves  local  operations  on  pixels,  using 
general  information  about  the  local  properties  (gray  level,  color, 
contrast,  etc.)  that  pixels  belonging  to  the  features  are  likely 
to  have.  Since  at  this  stage  we  are  examining  every  pixel,  it 

is  important  that  only  simple  computations  be  performed.  The 
principal  output  of  this  stage  is  a  set  of  line  segments  repre¬ 
senting  fragments  of  feature  edges,  and  labelled  with  various 


property  values  computed  for  these  fragments.  The  second  stage 
groups  these  edge  segments  into  pieces  of  features  ("feature 
segments"),  based  on  "semi-local"  properties  of  the  features 
(curvature,  parallel-sidedness ,  etc.);  the  third  stage  groups 
the  feature  segments  into  global  features,  using  global  infor¬ 
mation  about  their  shapes  and  spatial  relationships.  Thus  at 
each  stage,  the  computations  are  more  complex,  but  they  are 
applied  to  a  smaller  set  of  data. 

d)  Since  the  approach  involves  several  successive  stages  of 
segmentation  or  grouping,  if  errors  are  made  at  an  early  stage, 
they  may  be  difficult  to  correct  at  later  stages.  It  is  impor¬ 
tant  to  preserve  the  correspondences  between  entities  at  succes¬ 
sive  levels— i.e.,  between  edge  segments  and  the  pixels  that 
comprise  them,  and  between  feature  segments  and  the  edges  of 
which  they  are  composed;  this  will  make  it  easier  to  locate  the 
sources  of  any  errors.  It  is  also  highly  desirable  to  avoid  firm 
decisions  at  any  stage,  and  to  avoid  the  use  of  processes  that 
involve  thresholds,  but  rather  to  make  fuzzy  or  "probabilistic" 
decisions  whenever  possible,  thus  deferring  commitments  until 
they  are  confirmed  by  corroborating  evidence.  Note  that  when 
firm  decisions  are  made,  inputs  that  differ  by  arbitrarily  small 
amounts  may  give  rise  to  drastically  different  outputs.  If  such 
decisions  must  be  made,  they  should  be  based  on  as  much  informa¬ 
tion  as  possible. 

The  successive  stages  in  our  approach  are  described  in  the 


i 
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following  sections  of  this  paper,  and  specific  motivations  are 
given  for  the  types  of  knowledge  used  at  each  stage. 
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2.1  Edge  pixels 

Cultural  features  often  contrast  with  their  surrounds ,  and 
are  usually  bounded  by  sharp,  locally  straight  edges.  These 
characteristics  can  be  used  as  guidelines  in  classifying  pixels 
as  possibly  belonging  to  such  features.  On  the  other  hand,  infor¬ 
mation  about  feature  shapes  and  spatial  relationships  would  nor¬ 
mally  not  be  very  useful  in  making  decisions  about  pixels,  unless 
the  information  is  very  specific,  i.e.,  template -1 ike .  Knowing 
that  houses  are  rectangular,  for  example,  does  not  help  us  in 
classifying  a  pixel  as  being  possibly  part  of  a  house,  so  that 
we  can  say  very  little  about  how  it  should  be  related  to  other 
pixels  if  it  is  indeed  part  of  a  house. 

If  the  features  have  characteristic  gray  levels  or  colors, 
we  should  certainly  use  these  properties  in  making  decisions  at 
the  pixel  level;  but  in  nonmultispectral  imagery,  it  will  usually 
not  be  possible  to  characterize  features  in  this  way.  Moreover, 
if  we  do  classify  the  pixels  based  on  their  gray  levels,  we  will 
often  obtain  large  connected  components  of  constant  gray  level ; 
thus  using  a  very  local  classification  criterion  (the  pixel's 
gray  level)  may  give  rise  to  relatively  global  segments,  and 
this  will  often  be  unwarranted. 

These  considerations  have  led  us  to  propose  the  use  of  an 


edge-based  approach  at  the  pixel  level.  We  first  use  local 
operators  to  estimate  the  magnitude  and  direction  of  the  gradient 


at  each  point.  We  then  use  an  iterative  process  at  the  pixel 
level  to  adjust  the  magnitudes  and  directions  in  the  following 
way: 


a)  The  magnitude  is  increased  in  the  presence  of  high  magni¬ 
tudes  at  neighboring  points  in  the  tangential  direction, 
provided  their  directions  are  smooth  continuations  of  that 
direction;  and  it  is  decreased  in  the  absence  of  such 
neighbors.  This  strengthens  the  edge  responses  at  points 
that  lie  on  straight  or  smoothly  curved  edges,  and 
weakens  them  elsewhere. 

b)  At  the  same  time,  the  direction  is  adjusted  to  make  it 
agree  more  closely  with  these  neighboring  directions;  the 
amount  of  adjustment  depends  on  the  magnitude  at  these 
neighbors.  This  tends  to  smooth  out  irregularities  in 
the  edge  responses  caused  by  noise. 

c)  An  iterative  scheme  could  also  be  used  [1]  for  edge  thin¬ 
ning;  The  magnitude  is  reduced  in  the  presence  of  higher 
magnitudes  at  neighboring  points  in  the  gradient  direction, 
and  increased  in  the  presence  of  lower  magnitudes.  If 
this  is  done  iteratively,  the  magnitudes  at  the  tops  of 
the  "ridges"  of  responses  increase,  while  those  at  other 
points  decrease,  so  that  the  edge  responses  are  thinned. 


Thus  this  process  should  produce  sets  of  high-magnitude  responses 
that  lie  on  (thin)  straight  (or  smoothly  curved)  edge  segments, 
and  such  that  the  associated  directions  are  locally  very 


consistent.  Note  that  the  process  involves  no  thresholds  or 
decisions,  and  that  it  is  readily  implementable  in  parallel. 

Figure  1  illustrates  the  results  of  applying  such  processes 
to  the  edge  responses  in  a  small  portion  of  an  aerial  photograph 
of  the  Occoquan,  VA,  area.  The  desired  enhancement  effects  are 
all  quite  apparent.  No  thinning  was  done,  so  that  the  magnitude 
reinforcement  process  tends  to  thicken  the  edges;  but  this  is 
not  considered  harmful,  since  in  any  case  line  segments  will  be 
fitted  to  the  edges  at  the  next  step,  and  these  will  be  much  the 
same  whether  or  not  the  edges  are  thin — in  fact,  they  may  be  more 
reliable  if  the  edges  are  thick.  The  specific  algorithms  used 
were  described  in  an  earlier  technical  report  [2] .  Many  variations 
on  these  algorithms  could  have  been  used,  and  would  have  yielded 
similar  results;  e.g.,  see  [3].  An  edge  enhancement  relaxation 
scheme  could  also  have  been  used  [4]. 


2 . 2  Edge  segments 


We  now  want  to  construct  a  data  representation  based  on 
entities  more  global  than  pixels;  this  will  allow  us  to  use 
more  global  knowledge  about  cultural  features,  e.g.,  simple  types 
of  shape  information,  to  classify  these  entities.  Straight  or 
smoothly  curved  edge  segments  are  obvious  choices  for  these 
entities,  since  the  pixel-level  processes  tend  to  produce  sets 
of  edge  responses  that  lie  along  such  segments. 

Extracting  edge  segments  inherently  involves  some  sort  of 
threshold  criterion,  since  one  must  decide  whether  or  not  to 
construct  a  segment  corresponding  to  a  given  collection  of  edge 
responses.  Such  decisions  should  be  easier  for  enhanced  responses, 
but  they  are  still  nontrivial,  and  should  be  made  on  the  basis 
of  as  much  information  as  possible.  If  we  simply  threshold  the 
(enhanced)  edge  magnitudes,  we  are  making  the  decisions  on  a  pixel 
by  pixel  basis,  using  only  the  information  concerning  that  pixel, 
which  is  undesirable.  (Note,  however,  that  when  we  do  this  for 
enhanced  responses,  the  information  associated  with  a  pixel  also 
reflects  the  nature  of  its  neighbors.) 

A  somewhat  safer  idea  is  to  make  decisions  about  pixels  in 
the  context  of  their  neighborhoods.  For  example,  one  might  "accept" 
a  pixel  if  its  own  magnitude,  and  the  magnitudes  of  two  of  its 
neighbors  in  the  tangential  directions,  are  sufficiently  high. 

(Note  that  this  idea  is  very  compatible  with  the  enhancement 
process?  it  essentially  accepts  just  those  pixels  that  would  be 


strongly  enhanced.)  At  the  same  time,  one  can  establish  links 
between  each  accepted  pixel  and  its  neighbors;  these  links  can 
then  be  used  to  define  connected  components  of  accepted  pixels, 
which  then  constitute  the  desired  edge  segments.  Such  a  linking 
approach  is  used  by  Navatia  and  Babu  [5].  Alternatively,  one 
can  use  a  global  straightness  criterion  in  defining  the  connected 
components  by  requiring  each  pixel's  direction  to  lie  close  to 
the  average  direction  of  the  already  accepted  pixels  [2] ;  this 
breaks  up  smooth  curves  into  segments  having  relatively  low  net 
changes  in  slope  from  one  end  to  the  other.  Figure  2  illustrates 
the  types  of  edge  segments  obtained  using  this  criterion. 

It  would  be  even  more  desirable  to  make  decisions  about  entire 
groups  of  linkable  dge  pixels;  but  the  number  of  such  groups  is 
enormous,  and  it  is  utterly  impractical  to  consider  all  of  them. 
However,  suppose  that  we  are  only  interested  in  groups  of  edge 
pixels  that  lie  on  a  curve  of  a  given  shape,  e.g.,  on  a  straight 
line.  In  this  case  we  can  use  a  Hough  transform  approach  to  map 
collinear  sets  of  edge  responses  into  compact  peaks  in  the  Hough 
space.  We  must  then  use  a  threshold  criterion  to  detect  the 
peaks,  but  this  criterion  is  now  being  applied  to  an  entire  group 
of  collinear  edge  pixels,  rather  than  on  a  pixel  by  pixel  basis. 

It  should  be  mentioned  that  we  obtain  a  cleaner  Hough  space  when 
we  use  enhanced  edge  responses,  since  the  slope  estimates  are 
much  more  consistent  than  in  the  raw  responses ,  and  this  in  turn 
makes  the  estimates  of  the  distances  of  lines  from  the  origin 


much  more  consistent.  Of  course,  we  should  not  merely  use 
slope  and  distance  (and  response  magnitude)  to  define  clusters 
in  Hough  space;  other  properties  associated  with  the  edge  re¬ 
sponses,  e.g.  the  gray  levels  on  the  two  sides  of  the  edge, 
should  also  be  used  if  appropriate,  to  differentiate  between 
responses  that  (probably)  belong  to  different  edges.  It  may  even 
be  desirable  to  use  position  along  the  line  as  a  feature,  in 
order  to  avoid  clustering  responses  that  are  far  apart  in  the 
image  and  have  no  responses  between  them.  Such  global  approaches 
to  edge  segment  construction  deserve  further  investigation. 
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We  now  have  a  set  of  edge  segments,  with  each  of  which  we 
can  associate  various  properties,  including  its  length,  average 
slope,  average  strength,  etc.,  as  well  as  properties  of  the 
gray  levels  on  the  two  sides  of  the  segment's  constituent  edge 
pixels,  e.g.,  the  means  and  standard  deviations  of  these  gray 
levels.  If  desired,  we  can  now  use  this  information  to  search 
for  missing  parts  of  edges  in  the  original  image,  so  as  to  fill 
gaps  in  the  edge  segments  and  create  longer  ones.  We  can  also 
now  group  the  edge  segments  into  cultural  feature  segments,  based 
on  our  knowledge  about  the  expected  geometrical  properties  of 
these  segments.  In  this  section  we  discuss  some  possible 
approaches  to  edge  segment  grouping.  For  simplicity,  we  consi¬ 
der  two  simple  types  of  grouping,  based,  respectively,  on  good 
continuation  and  on  parallelism. 

Straight  segments  that  are  collinear,  or  curved  segments 
that  "point  toward"  one  another,  can  be  linked  using  criteria 
based  on  strength,  length,  distance,  and  good  continuation,  as 
well  as  similarity  of  properties  [6].  (This  assumes,  of  course, 
that  such  linking  is  consistent  with  what  we  know  about  the 
features  that  we  are  trying  to  extract.)  Linking  across  large 
gaps  can  be  done  much  more  reliably  at  the  segment  level  than 
at  the  pixel  level,  since  the  information  that  we  have  about 
the  segments  (slope,  property  similarity,  etc.)  is  more  reliable 
than  the  corresponding  information  about  pixels.  At  the  same 


time,  exploration  of  large  gaps  at  the  pixel  level  would  involve 
an  excessive  amount  of  computation  per  pixel. 

This  type  of  linking  involves  pairwise  decisions;  as  pointed 
out  in  Section  2.2.,  it  would  be  preferable  to  make  decisions  about 
entire  groups  of  segments  as  to  whether  or  not  they  constitute 
good  groupings,  rather  than  making  decisions  about  two  segments 
at  a  time.  In  general,  it  is  not  practical  to  consider  all  pos¬ 
sible  combinations  of  segments;  but  if  we  restrict  ourselves  to 
sets  of  collinear  segments  (or  more  generally,  segments  that  lie 
on  a  curve  of  known  shape) ,  it  is  computationally  feasible  to 
evaluate  all  possible  sets  of  consecutive  segments  as  possible 
groupings.  Various  criteria  for  evaluating  sets  of  collinear 
segments  have  been  formulated  that  yield  perceptually  reasonable 
results  [7] ;  Figure  3  illustrates  one  simple  possibility. 

In  addition  to  segment  linking  based  on  collinearity  or  good 
continuation,  one  usually  also  wants  to  link  pairs  of  "anti¬ 
parallel"  segments,  representing  pairs  of  parallel  edges  whose 
dark  sides  or  light  sides  face  one  another,  since  cultural 
features  often  have  parallel  sides.  In  the  work  of  Nevatia  and 
Babu  [5]  and  of  Brooks  [8] ,  links  are  formed  only  for  pairs 
having  no  segments  between  them;  but  in  general,  we  should  be 
allowed  to  link  two  segments  even  if  there  are  other  segments 
between  them,  since  these  other  segments  may  be  due  to  noise,  or 
may  represent  features  internal  to  the  given  one  (e.g.,  a  pent¬ 
house  on  a  building,  a  divider  strip  on  a  highway) .  Thus  in 


general  we  must  compute  link  merits  for  many  pairs  of  segments, 
and  then  choose  "best"  pairs  for  actual  linking.  The  merit 
function  may  depend  on  the  strengths,  slopes,  lengths,  and  pro¬ 
perty  value  similarity  of  the  segments,  as  well  as  on  their 
degree  of  overlap  and  on  the  distance  between  them,  and  on  any 
special  knowledge  that  we  may  have  about  the  properties  of  the 
desired  features.  Note  that  the  merit  may  be  asymmetrical;  for 
example,  if  a  short  segment  and  a  long  segment  face  one  another, 
the  merit  of  linking  the  short  one  to  the  long  one  may  be  much 
higher  than  that  of  linking  the  long  one  to  the  short  one. 

Given  the  merits  for  all  pairs  of  segments,  we  can  link  all 
pairs  having  (mutually)  highest  merit;  once  we  have  done  this, 
the  linked  segments  are  no  longer  candidates  for  linking,  so  that 
some  of  the  remaining  pairs  may  now  have  mutually  highest  merit 
and  can  now  be  linked.  This  process  can  be  repeated  until  no 
further  linking  is  possible.  Figure  4  shows  the  results  of 
applying  this  process  using  a  very  simple  merit  function,  namely 
the  fraction  by  which  one  segment  overlaps  the  other  divided  by 
the  distance  between  them,  provided  the  segments  have  approxi¬ 
mately  equal  slopes.  Several  variations  of  this  approach  have 
also  been  tried,  with  essentially  identical  results  19].  An 
additional  example  is  shown  in  Figures  l'-4',  which  are  analo¬ 
gous  to  Figures  1-4. 

The  antiparallel  linking  schemes  just  described  are  all 
based  on  pairwise  decisions.  As  before,  it  would  be  preferable 


to  evaluate  groupings  of  segments  that  form  antiparallel  strips, 
rather  than  linking  such  segments  two  at  a  time.  This  would 
allow  us  to  combine  the  collinear  and  antiparallel  linking  pro¬ 
cesses  into  a  single  strip  clustering  process.  Here  again,  a 
Hough-like  approach  might  be  used  to  detect  clusters  arising 
from  strips. 


Up  to  now  we  have  discussed  general  approaches  to  the 
problem  of  edge  segment  construction  and  grouping.  In  this 
section  we  develop  a  more  specialized  approach,  aimed  at  ex¬ 
tracting  groupings  that  represent  buildings  and  roads  on  an 
aerial  photograph.  Edge  segments  are  constructed  as  described 
in  Section  2.2.  We  associate  various  properties  with  each  seg¬ 
ment,  including  its  length,  average  edge  strength,  average 
gray  level  on  each  side  of  it,  etc.  These  properties  are  used 
to  derive  initial  probabilities  that  the  segment  is  part  of  a 
road,  part  of  a  building,  or  neither  (we  refer  to  this  last 
alternative  as  "other").  Groups  of  segments  are  then  formed, 
and  the  segment  probabilities  are  updated  based  on  properties 
of  the  groups. 


3.1  Average  gray  level  calculation 


In  order  to  calculate  the  initial  probability  assignments, 
we  have  to  find  the  average  gray  level  on  both  sides  of  a  line. 
The  algorithm  for  calculation  of  average  gray  level  on  both 
sides  of  an  edge  segment  is  as  follows: 

1)  Generate  a  strip  of  width  "d"  on  each  side  of  the  seg¬ 
ment.  Find  the  co-ordinates  of  the  points  inside  the 
two  strips  as  well  as  the  number  of  points  on  each  side. 

2)  Calculate  the  average  gray  level  on  each  side  by  dividing 
the  sum  of  the  gray  levels  by  the  number  of  points  on 
each  side. 

The  algorithm  starts  by  reading  in  the  coordinates  of  the 
end  points  of  each  line.  Then  the  slope  of  the  line  is  calcu¬ 
lated.  At  this  point  it  is  determined  whether  the  angle  (0)  of 
the  line  with  respect  to  the  x-axis  is  between  0  and  90  degrees 
or  is  between  90  and  180  degrees.  This  differentiation  is 
necessary  in  order  to  define  a  sense  for  each  side  of  the  line 
segment . 

Referring  to  Figure  5,  the  end  points  are  designated  as  end 
point  1  and  end  point  2.  The  sides  are  denoted  similarly.  Using 
the  conventions  in  Figure  5,  the  following  equations  can  be 
written  for  each  edge  segment  and  for  the  boundaries  of  the 
strips  on  both  sides  of  each  segment.  When  9  is  not  equal  to 
90  degrees  we  have: 


yQ (x)  =  mx  +  mx^  + 


Yl3 (x)  =  -x/m  +  x^/m  +  yx 

y14  (X)  =  “X//m  +  x2^m  +  y2 
y  1 1  (ac)  =  mx  ~  m(x-^  +  Ax)  +  y^  -  Ay 

y12<x)  =  mx  -  mfx.^  -  Ax)  +  y^  +  Ay 

where  Ax  =  d  sin0,  m  =  (y1~y2) / (x^-x^ 

Ay  =  d  cos0  when  0  s  8  <  90 

and  Ay  =  -d  cos0  when  90  <  6  <  180 

When  0  is  equal  to  90  degrees  we  have  the  following  equa¬ 
tions  for  the  boundary  lines  of  the  strip.  This  case  is  shown 
in  Figure  4  and  the  equations  are : 


0  =  Xy  =  x2. 

X11  ~  Xi 

12  =  X0  "  d' 

y13  =  y 

14  =  y2 

The  digitized  image  is  given  in  the  form  of  a  rectangular 
matrix  of  elements  g(i,j)  in  which  (i,j)  are  the  Cartesian  coor¬ 
dinates  of  a  point  and  g(i,j)  is  the  value  of  the  brightness  at 
the  point  (i , j )  . 

In  order  to  calculate  the  gray  level  averages  inside  the 
strips,  we  sum  up  the  gray  levels  of  those  points  which  satisfy 
the  conditions  below  and  divide  by  the  number  of  points  in  the 
strip: 

Average  gray  level  =  I  g(i,j)/n 

irj 

The  points  inside  each  strip  should  satisfy  the  following 
conditions : 


1)  When  0°  s  6  <  90° 

a)  For  side  "l" 

x2  4  i  *  x1  +  Ax 

yu(i)  <  D  <  Yo*1* 

b)  For  side  "2" 

*2  '  \  ‘  1  4  *1 

y0(i)  <  j  <  y12 {i) 

2)  When  90°  <  0  <  180° 

a)  For  side  "1" 

Xj^  4  i  4  x2  +  Ax 

y0(i>  <  j  <  yu(i) 

b)  For  side  "2" 

x^  -  Ax  4  i  4  x2 

y12U>  <  j  <  y0U> 

3)  When  0  =  90 

a)  For  side  "l” 

x^  -  d  4  i  <  x^ 

b)  For  side  "2" 

x^  <  i  <  x^  +  d 


y2  -  Ay  4  j  4  y1 

y14u)  <  j  <  y13<i> 

y2 (i)  4  j  <  y1  +  Ay 

y14(i)  <  3  <  Yi3(i) 

y2  4  i  4  Yi  +  Ay 

Y14(i)  <  j  <  y13(i) 

y2  -  Ay  4  j  4  Yi 

y14U)  <  j  <  y13(i) 

Yl  4  j  &  y2 

yl  *  j  *  y2 


3.2  Initial  probability  assignment 

One  of  the  most  useful  properties  that  can  be  used  for 
calculation  of  the  initial  probability  assignment  vector  is 
the  average  gray  level  in  a  strip  on  each  side  of  the  segment. 
These  averages  can  then  be  compared  with  typical  gray  levels  of 
cultural  features  such  as  roads  or  buildings.  The  minimum  dif¬ 
ference  of  these  side  average  gray  levels  from  the  typical  gray 
levels  of  roads  and  buildings  is  used  as  a  figure  of  merit  in 
the  calculation  of  initial  probabilities. 

Roads  and  buildings  are  the  brightest  objects  on  the  photo¬ 
graphs  that  we  used.  They  also  have  similar  gray  levels  (similar 
reflectances)  in  the  scene.  Using  these  facts,  in  what  follows 
an  automatic  method  for  estimating  the  gray  level  is  described. 

1)  Calculate  the  average  gray  level  in  a  strip  on  each  side 
of  each  line  segment. 

2)  Sort  the  line  segments  in  decreasing  order  of  length. 

3)  Select  the  longest  p%  of  the  lines  (usually  5%). 

4)  Calculate  the  average  gray  levels  of  the  brightest  sides 
of  the  lines  selected  in  step  (3) . 

The  average  gray  level  calculated  in  this  way  can  be  accepted 
as  a  good  estimate  for  the  typical  gray  level  of  the  objects. 

To  define  the  process  of  calculating  the  figures  of  merit 
more  precisely,  each  line  segment  in  the  scene  has  two  sides. 

The  average  gray  levels  of  the  strips  along  the  two  sides  of 
the  segment  are  denoted  by  gl  and  g2  (see  Figure  7) . 


Suppose  that  the  typical  average  gray  levels  of  roads  and 
buildings  are  gr  and  gh  respectively.  Then  the  differences 
fl  =  |gr  -  gl|  and  f 2  =  |gr  -  g2| 

measure  the  dissimilarity  between  the  two  sides  of  the  line 
segment  and  the  gray  level  of  a  typical  road.  Therefore,  the 
function  sr  =  min(fl,f2)  is  a  measure  of  the  gray  level  simila¬ 
rity  between  the  given  line  segment  and  a  typical  road.  Similarly 
the  differences 

hi  =  | gh  -  gl |  xnd  h2  =  ) gh  —  g2 | 
measure  the  dissimilarity  between  the  two  sides  of  the  line  seg¬ 
ment  and  the  gray  level  of  a  typical  building,  and  the  function 
sh  =  min(hl,h2)  is  a  measure  of  the  gray  level  similarity  between 
the  given  line  segment  and  a  typical  building. 

Finally, 
s  =  min(sr,sh) 

will  be  small  if  the  gray  level  average  on  one  of  the  sides  of  the 
line  segment  is  close  to  the  gray  level  of  a  typical  building  or 
road.  Therefore,  if  s  is  small  the  line  segment  is  more  probable 
to  be  an  edge  of  a  road  or  a  building  than  to  be  an  "other" 
type  of  edge,  whereas  if  s  has  a  large  value,  the  probability 
that  the  line  segment  is  in  the  "other"  class  is  high. 

In  order  to  express  the  value  of  s  as  a  figure  of  merit, 
linear  functions  are  used.  Let  di  (  i  =  1,2,3)  represent  the 
figures  of  merit.  To  define  them  as  linear  functions  of  s,  the 
following  linear  expression  is  used  for  calculation  of  a  road 


figure  of  merit.  This  linear  function  is  shown  in  Figure  8  by 

thin  solid  lines. 

(1/dgr-l/gr) (g-gr)  +  1 
2 

when  (g  r-2gr* dgr ) /  (gr-dgr )  &  g  s  gr 
2  2 

dl  =  “  0  when  g  r/ (gr-dgr)  <  g  <  (g  r-2gr* dgr) / (gr-dgr) 

(1/gr-l/dgr) (g-gr)  +  1 
„  when  gr  s  g  i  g  r/ (gr-dgr) 

Here  dgr  is  the  deviation  allowed  for  road  gray  level;  beyond 
it,  the  figure  of  merit  of  "other"  will  become  greater  than  the 
figure  of  merit  of  road.  The  value  of  g  is 
g  =  gl  if  fl  <  f 2 

and 

g  =  g2  if  fl  >  f2 

Similarly  the  figure  of  merit  for  a  line  segment  being  a  piece 

of  building  is  shown  by  the  thick  solid  lines  in  Figure  8  and 

its  expression  is  as  follows: 

' (1/dgh-l/gh) (g-gh)  +  1 
2 

when  (g  h-2glv  dgh)  /  (gh-dgh)  £  g  s  gh 

d2  =  "0  when  g2h/(gh-dgh)  <  g  <  (g2h-2gh* dgh) / (gh-dgh) 

(1/gh-l/dgh) (g-gh)  +  1 

2 

„  when  gh  s  g  i  g  h/ (gh-dgh) 

Here  dgh  is  the  deviation  allowed  for  building  gray  level; 
beyond  it,  the  figure  of  merit  of  "other"  becomes  greater  than 
the  figure  of  merit  of  buildings.  The  value  of  g  is 
g  =  gl  if  hi  <  h2 

and 


g  *  g2  if  hi  >  h2 


When  sr  <  sh  road  is  more  probable;  therefore  we  use  the 
dashed  line  for  calculation  of  the  figure  of  merit  for  "other" . 
Similarly  when  sr  >  sh  buildings  are  more  probable  and  the  dotted 
line  is  used  for  calculation  of  the  figure  of  merit  for  "other". 
In  summary,  the  figure  of  merit  for  the  "other"  class  is  calcu¬ 
lated  using  the  following  formula: 

When  sr  <  sh 

hi  =  fkr  ~  g|/gr  when  0  <  g  <  2gr 

1  when  g  £  2gr 

Similarly  when  sr  >  sh 

jo  _  r |gh  ~  g|/gh  when  0  <  g  <  2gh 

1  when  g  i  2gh 

The  initial  probability  for  each  label  is  obtained  by 
dividing  the  figure  of  merit  of  each  label  by  the  sum  of  the 
figures  of  merit  of  the  three  labels.  Defining  the  initial 
probability  in  this  manner,  we  have 

3 

p,(0)  (i)  =  di/  E  di  i  =  1,2,3 
i=l 

where  di  (i  =  1,2,3)  is  the  figure  of  merit  of  each  label  using 
the  previous  linear  formulation  and  X  is  the  edge  segment  label. 

When  we  use  the  functions  in  Figure  8,  many  segments  will 
have  probability  1  of  belonging  to  the  "other"  class.  These 
segments  can  be  discarded  as  noise. 


The  next  step  after  noise  cleaning  is  to  group  the  line 
segments  in  a  meaningful  manner.  In  order  to  do  this,  models 
of  the  edges  constituting  objects  should  be  used.  The  models 
of  roads  and  buildings  used  in  the  program  will  now  be  described. 

a)  The  model  of  edges  belonging  to  a  piece  of  a  road 

From  the  function  of  a  road,  it  follows  that  certain  physical 
and  geometrical  requirements  must  be  satisfied.  The  properties 
used  in  this  model  are  as  follows: 

1)  The  spectral  properties  of  a  road  correspond  to  materials 
such  as  concrete  and  asphalt  and  it  is  usually  homogeneous 

2)  A  piece  of  an  edge  of  a  road  should  have  an  anti-parallel 
edge. 

3)  A  piece  of  an  edge  of  a  road  is  usually  connected  to 
other  neighboring  pieces  with  low  angle  deviation. 

b)  The  model  of  edges  belonging  to  a  building 

Similarly,  the  physical  and  geometrical  properties  of  a 

building  are: 

1)  The  spectral  properties  of  the  roof  of  the  building. 

2)  The  similarity  of  gray  level  inside  the  edges  consti¬ 
tuting  a  building. 

3)  A  piece  of  an  edge  of  a  building  is  connected  to  other 
pieces. 

4)  The  edges  of  a  building  form  a  closed  figure  (usually 
with  right  angles) . 


In  order  to  use  the  above  models  the  geometric  relationships 
between  each  pair  of  lines  within  a  neighborhood  in  the  scene 
should  be  studied.  In  general,  using  the  conventions  of  Figure 
5,  every  pair  of  lines  in  the  scene  belongs  to  one  of  sixteen 
cases.  These  cases  are  listed  in  Table  1.  The  entry  "side"  in 
Table  1  refers  to  the  object  side  of  the  given  segment. 

In  order  to  find  the  object  side  of  a  line  segment,  first 
the  two  values  sr  and  sh  are  calculated.  Then,  using  the  fol¬ 
lowing  decision  rules  the  object  side  is  found: 
when  sr  <  sh 

if  fl  <  f2  side  =  1 

else  side  =  2 

and 

when  sr  >  sh 

if  hi  <  h2  side  =  1 

else  side  =  2 

Assume  that  the  pair  of  lines  under  study  are  labeled  as 
line  A  and  line  B.  The  angles  of  the  two  lines  with  respect  to 
the  x-axis  are  0A  and  0fi  respectively.  Depending  on  the  orien¬ 
tation  of  the  pair  of  lines,  different  angles  between  the  two 
lines  are  possible.  Figure  9  shows  examples  of  the  angle  0 
between  two  lines.  The  plus  sign  indicates  the  side  of  the 
road  or  building.  According  to  this  convention  the  angle  between 
two  collinear  lines  is  180°. 


4. 1  Compatible  pairs 

We  now  give  the  details  of  the  algorithm  for  finding 
compatible  pairs  of  segments,  i.e.,  pairs  that  might  be  con¬ 
secutive  edge  segments  of  a  building  or  road.  Referring  to 
the  model  of  edges  constituting  the  objects,  each  of  these 
pairs  of  lines  should  satisfy  certain  conditions  in  order  to 
be  accepted  as  a  candidate  compatible  pair.  In  general,  these 
conditions  are: 

a)  Similarity  of  gray  level  of  a  strip  along  a  line  con¬ 
necting  their  ends  with  respect  to  the  object  side  of 
the  pairs. 

b)  Conditions  on  the  geometrical  configuration  of  the  pair 
of  lines. 

To  check  the  similarity  condition,  the  average  gray  level  on 
the  object  side  of  the  pair  of  lines  is  calculated  by 

g  =  (gA  +  gB)/2 

where  gA  and  gB  are  the  average  gray  levels  of  the  strips  along 
the  object  sides  of  lines  A  and  B.  Then,  the  corresponding 
average  gray  level  of  a  strip  along  a  line  connecting  the  ends 
of  the  lines  is  calculated.  The  difference  between  this  value 
and  g  is  a  measure  of  the  gray  level  similarity  of  the  line  con¬ 
necting  the  two  ends  with  the  pair  of  lines.  If  this  difference 
is  within  the  limits  used  in  calculation  of  the  figures  of  merit, 
then  the  similarity  condition  is  satisfied. 


In  a  case  where  the  distance  between  the  ends  is  very  small, 
that  is,  comparable  with  the  width  of  the  strip  used  in  calcu¬ 
lation  of  the  gray  level,  the  similarity  measure  is  not  reliable. 
This  is  because  the  number  of  points  used  in  calculation  of 
the  gray  level  is  limited.  In  cases  where  the  distance  between 
the  ends  of  pair  under  study  is  less  than  the  width  of  the  strip 
used  in  calculation  of  the  average  gray  level,  the  similarity 
condition  will  not  be  checked.  In  this  case  the  pair  is  consi¬ 
dered  as  a  compatible  candidate  if  the  appropriate  geometrical 
conditions  are  satisfied. 

Geometrical  conditions  are  important  in  making  two  lines 
compatible.  Figure  10  and  Figure  11  show  examples  of  geometrically 
compatible  and  incompatible  pairs,  respectively.  To  differentiate 
between  geometrically  compatible  and  incompatible  pairs,  certain 
constraints  on  the  geometrical  locations  of  the  end  ini;s  are 
necessary.  The  ratio  of  the  distances  between  end  points  can  be 
used  to  reject  the  geometrically  incompatible  pairs. 

In  what  follows,  the  first  four  cases  in  Table  1  will  be 
analyzed  and  their  compatibility  conditions  derived.  The  other 
cases  have  similar  conditions. 

Case  (1) 

Referring  to  Figure  12,  there  are  five  different  configura¬ 
tions.  In  this  case  the  compatibility  of  line  A  with  respect  to 
line  B  at  end  (2)  or  the  compatibility  of  line  B  with  respect  to 
line  A  at  end  (1)  is  considered.  Table  2  summarizes  the  conditions 


r 


imposed  in  these  cases.  The  parameter  m  in  the  table  is  taken 
to  be  1.5.  This  allows  some  overlap  between  the  pairs  of  com¬ 
patible  line  segments.  The  angle  between  the  two  lines  is 

9  -  ’  -  IV9bI  if  6b  ‘  9a 

and 

9  -  ’  -  IV9bI  if  eB  2  eA 
Case  (2) 

In  this  case  seven  different  configurations  are  considered. 
These  are  shown  in  Figure  13.  The  compatibility  of  end  (1)  of 
line  A  or  line  B  is  considered.  Table  3  summarizes  the  required 
conditions.  The  angle  between  the  two  lines  in  this  case  is 
0  =  2tt  -  |  0 A~ 0 B  |  when  ya2  <  yO 

and 

0  =  (0A"0BI  when  ya2  >  yO 

where 

y^  =  mb-xa2  -  mb*xbl  +  ybl 

and  mb  is  the  slope  of  line  B.  The  conditions  at  end  (2)  of 
the  lines  are  similar  to  the  end  (1)  conditions.  To  find  these 
conditions  al  and  bl  should  be  changed  to  a2  and  b2  except  that 
in  this  case 

Yq  =  mb'xal  -  mb-xbl  +  ybl 

The  side  similarity  for  some  configurations  is  different  in 


this  case. 


Case  (3) 


When  the  compatibility  of  end  (1)  of  line  A  with  end  (2) 
of  line  B  is  considered,  there  are  five  different  configurations. 
Figure  14  shows  these  configurations.  The  conditions  are  sum¬ 
marized  in  Table  4.  The  angle  between  the  lines  is 

e  =  it  +  |eA-eB|. 

The  other  possibility  is  to  study  the  compatibility  of  end 
(2)  of  line  A  with  end  (1)  of  line  B.  Here  again  there  are 
five  different  configurations.  Figure  15  shows  these  confi¬ 
gurations.  The  conditions  are  summarized  in  Table  5.  The 
angle  between  the  lines  is 


Case  (4) 

The  conditions  for  this  case  are  summarized  in  Table  6  and 
Table  7.  The  different  configurations  are  shown  in  Figure  16  and 
Figure  17.  The  angle  between  the  lines  is 


when  the  compatibility  of  end  (1)  of  line  A  is  considered. 
Similarly  the  angle  is 
e  -  2,  -IV6bI 

when  the  compatibility  of  end  (2)  of  line  A  is  in  question. 

So  far  the  geometrical  and  similarity  conditions  for  the  pairs 
of  compatible  segments  have  been  found.  In  what  follows  the 
algorithm  for  finding  compatible  pairs  will  be  explained. 


i 
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Algorithm  for  Finding  Compatible  Pairs 

1)  Choose  those  line  segments  whose  "other"  property  is 
not  equal  to  1. 

2)  For  end  "1"  of  each  line,  find  the  shortest  distances  from 
other  end  points  of  line  segments . 

3)  Find  the  object  side  of  the  given  line  and  the  other  lines 
found  in  (2) . 

4)  Check  the  geometrical  and  similarity  conditions  for 

the  given  line  and  the  other  lines  found  in  (2) .  Reject 
those  lines  for  which  the  required  conditions  are  not 
satisfied. 

5)  If  all  the  lines  are  rejected  go  to  (8). 

6)  Find  the  angle  of  the  line  with  respect  to  the  remaining 
lines  in  (4).  Choose  the  line  which  has  the  smallest 
angle  (e.g.  greater  than  25°)  with  respect  to  the  line 
under  study. 

7)  Choose  the  other  end  of  the  line  found  in  (6)  and  go  on 
to  (2). 

8)  Choose  the  other  end  of  the  given  line  and  go  to  (2) . 

If  the  other  end  has  already  been  tested  go  to  (9) . 

9)  Continue  the  above  process  for  the  other  line  segments. 


4 . 2  Antiparallel  pairs 

The  edges  of  cultural  features  usually  occur  in  pairs,  as 
in  the  sides  of  roads  and  of  buildings.  To  identify  these 
features  the  edges  should  be  clustered  into  antiparallel  pairs 
(i.e.  pairs  of  facing  edges  that  are  parallel  but  have  opposite 
senses) .  Clustering  must  take  into  account  information  from 
the  picture  in  the  regions  around  the  edges.  For  example,  a 
road  usually  has  a  uniform  gray  level  and  thus  it  is  reasonable 
to  expect  the  facing  sides  of  an  antiparallel  pair  of  edges  to 
have  similar  gray  levels. 

The  present  method  finds  the  pairs  of  lines  that  are  anti¬ 
parallel  up  to  a  certain  angle  difference  (usually  25°)  when 
similarity  of  gray  level  between  the  pairs  is  satisfied. 

The  .basic  procedure  is  as  follows.  A  strip  is  moved  along 
the  object  side  of  each  side  segment.  The  movement  is  continued 
until  the  similarity  is  lost  or  the  distance  moved  is  greater 
than  the  largest  expected  object  size  in  the  scene.  While  the 
strip  moves,  it  hits  other  line  segments.  Among  these  line 
segments  the  following  segments  are  rejected: 

a)  If  they  are  not  anti-parallel 

b)  If  the  difference  in  the  angle  is  greater  than  a  threshold. 

The  similarity  is  defined  as  the  difference  between  the 


average  gray  level  of  the  moving  strip  and  the  average  gray  level 
of  the  object  side  of  the  edge  segment: 


|g-gmove|  <  level  of  similarity 
where  g  =*  average  gray  level  of  the  line  segment 
and  gmove  =  average  gray  level  of  the  moving  strip. 

The  level  of  similarity  used  in  the  program  is  taken  as  7,  which 
is  a  rather  tolerant  condition.  When  the  strip  hits  a  candidate 
line  the  level  of  similarity  is  automatically  changed  to  the 
value  of  the  contrast  of  the  candidate  line.  Note  that  this 
change  of  the  level  may  stop  the  movement  of  the  strip. 

Among  the  remaining  lines  the  one  which  has  the  smallest 
distance  is  selected  as  anti-parallel.  To  find  the  shortest 
distance  between  two  anti-parallel  line  segments,  at  each  end  of 
the  two  segments  perpendicular  lines  are  drawn  to  the  other  line. 
If  the  intersection  of  the  perpendicualr  with  the  facing  line  is 
located  outside  of  the  line,  the  distance  is  neglected.  Among 
the  remaining  distances,  the  minimum  is  selected  as  the  distance 
between  the  two  lines.  Figure  18  shows  an  example  of  calculating 
the  distance  between  two  lines.  As  shown  in  this  figure,  among 
the  four  distances 
di  (i  =  1,2, 3, 4) 
d3  and  d4  are  rejected  and 
d  =  min(dl,d2) 

is  selected  as  the  distance  between  the  two  lines. 

To  check  whether  the  intersection  of  the  perpendicular  line 
is  between  the  end  points  of  a  line  the  following  decision  rules 


are  used: 


if  0  is  not  equal  to  90  degrees 


and  xl  *  xint  *  x2  the  intersect  point  is  between  the  end  points 
else  if  0  is  equal  to  90  degrees 

and  yl  xint  *  y2  the  intersect  point  is  between  the  end  points. 
Here  (xint,yint)  are  the  coordinates  of  the  intersection  point. 

This  method  of  finding  anti-parallel  pairs  of  lines  has  the 
following  advantages: 

a)  Each  line  is  not  compared  with  all  other  lines. 

b)  When  several  lines  are  facing  a  line,  the  method  allows 

all  of  these  lines  to  choose  the  same  line  as  anti-parallel. 

c)  The  method  uses  the  context  of  the  lines  on  the  picture, 
namely,  the  similarity  of  the  gray  levels  inside  the  object. 

In  what  follows  the  algorithm  for  finding  anti-parallel  pairs 
is  explained. 

Algorithm  for  finding  anti-parallel  pairs 

1)  Choose  a  line  segment  and  find  its  object  side. 

2)  Generate  the  strip  (a  width  of  4  points  is  used) ,  and 
find  the  average  gray  level  inside  the  strip. 

3)  Move  this  strip  parallel  to  the  segment.  While  the 
similarity  and  the  total  movement  distance  are  less  than 
the  specified  levels,  note  the  lines  hit  by  the  strip. 

If  no  lines  are  found  go  to  (5).  Otherwise,  reject  those 
lines  where  the  angle  difference  is  greater  than  the 
specified  threshold  and  the  facing  side  is  not  opposite 
to  the  original  line.  Set  the  similarity  level  equal  to 
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the  contrast  of  the  line  found  and  continue  the  pro¬ 


cess  . 

4)  For  the  candidate  lines  found  in  (3)  choose  the  one 
which  has  the  minimum  distance.  Mark  the  line  found  in 
order  not  to  process  it  again. 

5)  Continue  the  process  for  the  remaining  lines. 

The  maximum  moving  distance  in  the  above  algorithm  is  quite 
relaxed;  it  is  set  to  be  equal  to  be  1/4  of  the  size  of  the  pic¬ 
ture.  For  scenes  containing  small  objects  this  distance  can  be 
reduced  in  order  to  reduce  computation  time.  The  angle  difference 
can  be  set  arbitrarily.  The  program  is  not  sensitive  to  this 
threshold  since  the  strip  moves  along  the  object  side  of  the  edge 
and  so  it  is  expected  that  we  get  another  side  of  the  object  as 
the  best  candidate. 


5 .  Groups  of  segments:  buildings  and  roads 

After  application  of  the  programs  described  up  to  now,  we 
have  groups  of  compatible  and  antiparallel  pairs  of  segments. 

Using  the  model  of  roads  and  buildings,  we  want  to  update  the 
probabilities  that  were  initially  obtained  using  gray  level 
information.  Based  on  these  probabilities  we  can  recognize 
objects  with  good  confidence  or  fair  confidence. 

We  begin  by  dividing  the  groups  of  compatible  pairs  into 
the  following  categories: 

A)  Closed  groups 

B)  Semiclosed  groups 

C)  Other  lines  and  groups 

In  what  follows  each  of  the  above  categories  will  be  explained 
in  more  detail. 

A)  Closed  groups 

By  a  closed  group,  we  mean  that  the  start  and  the  end  segment 
labels  are  the  same.  Figure  19  shows  an  example  of  this  type 
of  group.  In  this  figure  A,B,C....  are  the  labels  in  a  compati¬ 
ble  group. 

It  is  obvious  that  this  kind  of  closed  group  is  a  good  can¬ 
didate  for  being  the  group  of  edges  of  a  building.  To  check 
whether  this  closed  group  is  a  building,  we  test  for  solidness 
inside  the  object  sides,  and  also  check  that  each  line  segment 
in  the  group  is  antiparallel  to  a  line  in  the  group.  To  check 
solidness  we  use  the  same  operator  that  was  used  in  finding  the 


antiparallel  pairs.  This  test  also  guarantees  the  similarity 
of  gray  level  inside  the  object. 
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The  above  check  can  differentiate  between  the  cases  (b)  and 
(c)  in  Figure  19.  Thus  a  closed  group  with  the  above  conditions 
can  be  considered  a  building  with  good  confidence. 

B)  Semiclosed  groups 

A  semiclosed  group  is  defined  as  a  group  with  a  gap  less  than 
the  longest  line  connecting  the  ends  of  compatible  pairs  in  the 
group.  Figure  20  demonstrates  an  example  of  this  type.  As  in 
the  case  of  a  closed  group,  if  the  following  tests  are  valid, 
then  the  group  is  accepted  as  a  building  with  good  confidence. 

1)  Solidness 

2)  Each  line  should  be  antiparallel  to  a  line  in  the  group. 
Operators  similar  to  those  used  for  checking  closed  groups 

are  used  here. 

C)  Other  lines  and  groups 

Here  again  the  model  of  the  edges  constituting  a  building  or 
road  will  be  used  for  the  recognition  of  the  remaining  lines  or 
groups.  The  important  features  are  the  angles  between  the  com¬ 
patible  pairs  and  information  on  anti-parallel  pairs.  Figure  21 
shows  examples  of  possible  cases  that  may  occur  in  the  scene.  In 
this  figure  0min  is  around  200°.  Special  care  should  be  taken 
in  cases  where  the  anti-parallel  pairs  or  compatible  pairs  are  not 
available,  due  to  cutoff  at  an  edge  of  the  frame. 


We  now  describe  in  detail  the  algorithm  for  updating  the 
probabilities  of  "other"  lines  or  groups.  A  reinforcement 
algorithm  is  employed  to  update  the  probabilities  of  the  re¬ 
maining  line  segments  by  rewarding  and  punishing  (increasing  or 
decreasing  a  component  of  the  probability  vector) .  Here  again 
the  model  of  the  edges  constituting  the  objects  will  be  used 
for  the  updating  process.  The  most  important  features  are  the 
angles  between  compatible  pairs  and  information  on  antiparallel 
pairs.  For  example,  two  anti-parallel  lines  should  reinforce 
each  other  for  both  buildings  and  roads. 

We  begin  by  dividing  the  "other"  lines  and  groups  into  the 
following  categories. 

1)  Groups  consisting  of  two  compatible  lines 

2)  Groups  consisting  of  more  than  two  compatible  lines 

3)  Single  lines 

In  what  follows  the  criteria  for  classification  of  each  of 
the  above  categories  will  be  explained  in  more  detail. 

1)  Groups  consisting  of  two  compatible  lines 

The  two  compatible  lines  are  called  A  and  B.  There  are 
four  cases. 

Case  a 

Both  A  and  B  have  no  anti-parallel  lines  due  to  cutoff  at 
the  edges  of  the  frame.  Figure  22  shows  examples  of  this  case. 

If  the  angle  6  between  the  lines  is  close  to  90° ,  there  is  a 
high  probability  that  the  lines  are  a  part  of  a  building.  If  the 


angle  0  is  greater  than  90°  the  probability  that  the  edge  is  a 
part  of  a  road  is  higher.  Similarly,  if  the  angle  is  less  than 
90°  the  probability  of  being  "other"  is  higher.  In  order  to 
express  this  situation  the  following  figures  of  merit  are  defined: 
dl  =  f  1  (0)  [P^0)  (1)  +  P^0>  (1)  ] 

d2  =  f2  (0)  [pi0)  (2)  +  P*0)  (2)  ] 

d3  =  f 3  ( 0 )  [P^0)  (3)  +  P^0)  (3)  ) 

where  dl,  d2,  and  d3  are  the  figures  of  merit  for  road,  building, 
and  other,  respectively.  The  functions  f i  ( 0 )  (i  =  1,2,3)  are 
defined  as  follows: 
if  o  s.  0  *  tt/4 

fl(0)  =  0,  f  2  (0 )  =  0,  f  3  (0 )  =  1 

if  tt/4  <  0  a.  tt/2 

f 1 (0 )  =  0,  f 2  (0 )  =  1~ | cos0 |  ,  f 3 (0 ) =  0.25 

if  tt/2  <041 

f 1 (0 )  =  | cos0  J ,  f 2 ( 0 )  =  l-|cos0j,  f 3  (0 )  =  0.25 

if  TT  <  0<  2  TT 

f 1 (0 )  =  0.5,  f 2(0)  =  0,  f 3  (0 )  =  0.5 

Case  b 

One  of  the  lines  has  no  anti-parallel  due  to  cutoff  at  an 
edge  of  the  frame,  and  the  other  line  has  an  anti-parallel  line. 
Figure  23  shows  examples  of  this  case. 
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In  this  case  again  the  figures  of  merit  are  defined  as 


dl  =  f 1 ( 0 ) 

[p{°) 
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p(0) 
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(1)  1 
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d3  =  f  3  (0  ) 

>  — : 
-  o 
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2P<°> 
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p(0) 

A 
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where  label  A'  is  the  label  of  the  anti-parallel  line  of  A. 

The  functions  fi(0)  (i  =  1,2,3)  are  the  same  as  before.  In  this 

definition  the  probability  components  of  line  B  are  counted 

twice.  This  is  because  line  B  reinforces  both  lines  A'  and  A. 

For  these  two  cases  the  update  probability  is  defined  as 

(1)  ^ 

P,  (i)  =  di/  I  di  (i  =  1,2,3) 

A  i=l 

where  X  is  the  label  of  the  line  under  study. 

Case  c 

Both  A  and  B  have  anti-parallel  lines.  Figure  24  shows 
possible  examples  of  this  case.  In  order  to  recognize  this 
case  lines  are  drawn  between  the  midpoint  of  each  line  and  the 
corresponding  anti-parallel  line.  If  the  intersection  of  these 
two  lines  is  located  between  the  lines,  we  have  a  building  with 
good  confidence  and  therefore: 

(1)  =  0,  Px(1)  (2)  =  1,  Px(1)  (3)  =  0 

for  X  =  A, B, A' , B' . 

If  the  intersection  is  outside  the  lines  we  have  a  road  with  good 
confidence: 

Px1}  (1)  =  1,  P^15  (2)  =  0,  P^  (3)  =  0 


for  X  =  A, B , A1 ,B' 


Case  d 


This  case  includes  all  situations  not  covered  by  cases 
(a-c) — e.g.,  both  A  and  B  have  no  anti-parallel  lines  and  this 
is  not  due  to  cutoff.  In  these  cases  no  change  is  made  to  the 
probabilities . 

In  the  above  four  cases  if  the  anti-parallel  line  of  A  or  B 
was  previously  recognized  as  a  part  of  a  road  or  as  a  part  of  a 
building,  A  or  B  is  considered  as  a  line  with  no  anti-parallel. 

The  reason  for  this  is  that  the  anti-parallel  line  was  previously 
recognized  as  a  part  of  an  object  and  therefore  it  should  not 
reinforce  these  lines. 

2)  Groups  consisting  of  more  than  two  compatible  lines 

In  this  case  a  line  may  have  two  compatible  lines  at  its  ends. 
Examples  of  possible  roads  in  this  case  are  shown  in  Figure  25 
and  an  example  of  a  possible  building  is  shown  in  Figure  26. 

Notice  that  the  example  of  a  possible  building  shows  the  situ¬ 
ation  after  the  recognition  of  closed  and  semi-closed  groups. 

A  piece  of  an  edge  segment  A  is  classified  as  road  with  good 
confidence  if  the  following  conditions  are  satisfied: 


a) 

If 

it 

possesses  an 

antiparallel  line  A 

b) 

If 

01 

>  9min 

and 

@2  >  9min 

c) 

If 

9i 

>  8min 

and 

9^  >  9min 

or  if  the  line  has  no  antiparallel  because  of  cutoff  but  the 
neighboring  compatible  line  satisfies  the  above  conditions. 


Since  we  do  not  allow  sharp  turns  for  roads  9min  is  set  to 
be  110°. 

Special  care  should  be  taken  with  the  start  and  end  lines  of 
a  group  where  the  condition  for  one  angle,  6  or  is  satis¬ 
fied.  The  other  special  case  is  when  one  or  both  of  the  compa¬ 
tible  lines  have  no  antiparallel  because  of  cutoff.  In  this 
case  the  condition  on  0|  or  6^  will  not  be  checked. 

There  are  other  cases  where  a  line  does  not  have  an  anti¬ 
parallel  line  but  not  because  of  cutoff.  An  example  of  this  is 
shown  in  Figure  27 .  In  this  case  if  both  compatible  neighbors 
at  the  ends  are  classified  as  road  with  good  confidence,  then 
this  piece  will  also  be  classified  as  road  with  good  confidence. 
For  all  the  above  cases 

P)[1)(l)  =  1,  p[l)  (2)  =  0,  Px(1)(3)  =  0 

for  X  =  A, A' . 

An  edge  segment  is  classified  as  a  road  with  low  confidence 
if  it  satisfies  the  following  conditions: 

a)  It  has  no  anti-parallel,  not  due  to  cutoff 

b)  Only  one  compatible  neighbor  is  a  road  with  good  confi¬ 
dence  . 

In  this  case  the  probability  is  updated  as  follows: 

P^1) (1)  =  0.5,  P^1) (2)  =  0,  P^1} (3)  =  0.5 

To  classify  cases  where  ©1  or  ©2  is  less  than  0min,  the 
following  procedure  is  applied: 


a)  Within  the  group,  we  start  from  the  line  with  angle 
less  than  Omin;  then  other  neighboring  Lines  are  found 
that  satisfy  the  same  angle  condition.  Now  we  have  a 
semi-closed  group  candidate.  If  the  tests  stated  for 
semi-closed  groups  are  valid,  then  we  classify  these 
line  segments  as  buildings  with  good  confidence. 

b)  If  the  semi-closed  tests  are  not  valid,  the  classifica¬ 
tion  is  done  according  to  the  category  of  groups  consist¬ 
ing  of  two  compatible  lines.  Here  the  lines  are  con¬ 
sidered  two  by  two  and  the  classification  is  done  as 
before . 

The  recognition  for  other  cases  (e.g.,  none  of  the  lines 
have  antiparallels)  is  done  according  to  the  category  of  groups 
consisting  of  two  lines  as  before. 

3)  Single  lines 

These  are  single  lines  with  no  compatible  lines  at  the  ends. 
The  following  rules  are  applied  for  classification  of  single 
lines. 

a)  Classify  a  single  line  as  road  if  it  has  an  anti¬ 
parallel  line. 

b)  Classify  it  as  "other"  if  it  has  no  anti-parallel. 

A  simple  verification  step  for  isolated  road  lines  is  added 
in  order  to  reject  noisy  lines  that  have  prematurely  been  recog¬ 
nized  as  road  with  good  confidence.  The  isolated  road  lines  are 
verified  if  they  have  a  minimum  acceptable  length  for  roads. 


6.  Examples 


The  algorithms  described  in  Sections  3-5  were  applied  to 
three  images  showing  portions  of  a  suburban  area  near  Occoquan, 

VA  (compare  Figs.  l'-4'). 

Figure  28  shows  one  of  the  images,  and  Figure  29  shows  the 
lines  extracted  from  it.  The  average  gray  levels  were  calculated 
using  strips  of  width  4,  based  on  knowledge  about  the  resolution 
of  the  image.  The  typical  gray  levels  of  roads  and  buildings 
were  taken  to  be  equal  in  calculating  the  probability  vectors. 

The  histogram  of  "other"  probabilities  is  shown  in  Figure  30 • 
From  this  histogram  it  is  clear  that  we  can  completely  differen¬ 
tiate  between  two  classes  of  object  boundaries,  namely  objects 
and  noise.  Figure  31  shows  the  line  segments  whose  probabilities 
of  being  a  piece  of  road  or  building  are  not  equal  to  zero. 

This  figure  shows  quite  an  improvement  in  rejecting  the  noise 
edges.  Figure  32  shows  the  results  of  finding  compatible  seg¬ 
ments,  and  Figure  33  shows  the  results  of  finding  anti-parallel 
segments:  the  midpoints  of  the  anti-parallel  pairs  are  connected 
together.  Figures  34  and  35  show  the  high  confidence  buildings 
and  roads;  Figures  36  and  37  show  the  buildings  and  roads  with 
probabilities  ^  0.75,  and  Figures  38  and  39  show  those  with 
probabilities  ^  0.5. 

Two  other  examples  are  shown  in  Figures  40  ~ 50  and  51-61; 
these  are  analogous  to  Figures  2B -  39,  except  that  the  histograms 
of  "other"  probabilities  are  not  shown.  Two  further  examples 


taken  from  the  same  aerial  photograph,  but  involving  non- 
residential  buildings,  are  shown  in  Figures  62-69  and  70-77. 
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7 .  Variations 

7 . 1  Edge  segment  adjustment 

The  bottom-up  nature  of  the  approach  described  in  Sections 
3-5  makes  the  results  dependent  on  good  choices  of  the  initial 
edge  segments.  In  this  section  several  experiments  are  described 
aimed  at  improving  the  positions,  orientations,  or  lengths  of 
these  segments. 


a)  Changing  the  segment's  position 

In  this  experiment  the  line  segments  were  moved  a  few  steps 
in  each  direction  so  that  they  remained  parallel  with  the  given 
line.  Two  different  figures  of  merit,  namely  the  maximum  gra¬ 
dient  and  minimum  standard  deviation  of  the  gray  level  on  both 
sides  of  each  line,  were  used  to  evaluate  the  position  of  a  line 
segment.  Referring  to  Figure  79,  at  each  step  the  new  end 
coordinates  are 

x21  =  x2+Ax 
y21  =  y2-Ay 


x2  2  =  x2-Ax 
y22  =  y2+Ay 


xll  =  xl+Ax 
yll  =  yl-Ay 
for  side  1  and 

xl2  =  xl-Ax 
yl2  =  yl+Ay 
for  side  2  where  Ax  =  di  sin0 

Ay  =  di  cos0  when  0*  0  <90 
and  Ay  =  -di  cos0  when  90*  0  <180 

where  di  is  the  distance  moved  at  step  i  and  0  is  the  angle  of 
the  line  with  respect  to  the  x-axis. 
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At  each  step  the  average  gray  levels  on  side  1  and  side  2 
are  calculated.  The  gradient  at  step  i  is 
gi  =  g2-gl 

where  gl  and  g2  are  the  average  gray  levels  on  side  1  and  side 
2.  The  maximum  gradient  is  calculated  as 
gmax  =  max  j  gi j 

The  end  coordinates  of  the  line  associated  with  the  position  of 
the  maximum  gradient  are  selected  as  the  new  coordinates  of  the 
line  segment. 

Figure  79  shows  the  effects  of  this  method  on  the  line  seg¬ 
ments  of  Figure  29  for  four  steps  of  movement  in  each  direction 
and  di  =  1,2, 3, 4.  The  result  of  this  experiment  is  that  no  major 
change  of  position  was  made  for  long  line  segments,  but  there 
were  some  bad  effects  on  the  short  line  segments.  The  reason  is 
that  short  line  segments  are  moved  towards  the  neighboring  long 
segments  where  the  gradient  is  maximum. 

Another  figure  of  merit,  the  minimum  standard  deviation  of 
the  gray  levels  along  the  line  segments,  was  also  used  to  re¬ 
locate  the  lines.  The  standard  deviation  at  step  i  is 

o?  ■  l  (g(k,j)-g) 
k ,  j 

where  g(k,j)  is  the  gray  level  of  point  (k,j)  and  g  is  the 
average  gray  level  inside  each  strip.  The  minimum  standard 
deviation  is  calculated  as 
o^min  =  min | \ 


Figure  80  shows  the  effects  of  this  experiment.  As  shown  in 
this  figure  the  line  segments  have  the  tendency  to  relocate 
themselves  where  the  gray  levels  are  more  uniform.  The  result 
is  that  they  usually  move  towards  the  center  of  the  objects 
and  therefore  more  confusion  will  occur. 

b)  Changing  the  segment's  angle 

In  this  experiment  each  line  segment  is  rotated  around  its 
center  point  in  both  directions,  a  few  degrees  at  each  step. 

As  before,  two  different  figures  of  merit  were  used  to  relocate 
the  line  segments.  Referring  to  Figure  81,  at  each  step  the  new 
coordinates  are 

X1  =  xi-Ax  x2  =  x2+^x 

yl  =  Yl+Ay  y2  =  y2"Ay 

where  Ax  =  l  sin  ^/2  sin(9  +  ^i/2) 

Ay  =  l  sin  /2  cos (9+9i/2) 

where  is  the  angle  of  rotation  at  each  step  and  i  is  the 
length  of  the  line.  In  this  formulation  if  the  line  is  rotated 
anti-clockwise  is  taken  to  be  a  positive  number;  otherwise 
<p^  is  taken  to  be  a  negative  number. 

Figure  82  shows  the  results  of  changing  the  angles  after 
relocating  the  lines  in  the  position  of  maximum  gradient.  In 
general  no  improvement  has  been  made  regarding  the  positions  of 
the  line  segments  in  the  scene.  Similarly,  Figure  83  shows  the 
result  of  changing  the  angles  and  relocating  the  lines  in  the 


position  of  minimum  standard  deviation.  Here  again  no  improve¬ 
ment  has  been  made . 

In  the  above  experiments  is  taken  to  be  ix5°  and  four 
steps  of  rotation  are  allowed.  The  width  of  the  strip  along  the 
line  segment  is  taken  to  be  4.  Other  experiments  such  as  first 
rotation  and  then  translation  or  vice  versa  have  been  performed 
and  similar  results  have  been  found.  The  results  are  shown  in 
Figures  84  to  87. 

c)  Changing  the  segment 1 s  length 

When  lines  are  fitted  to  components  of  edge  points,  in  some 
places  the  lines  overshoot  the  components  at  their  ends.  This 
may  be  due  to  noise  in  the  edges  near  their  ends  or  to  the  pre¬ 
sence  of  nearby  edges  with  similar  directions.  To  study  this 
effect  some  experiments  have  been  performed  to  adjust  the  length 
of  the  fitted  lines.  The  similarity  of  gray  scale  along  the 
object  side  of  the  segment  is  used  for  this  type  of  adjustment. 
Referring  to  Figure  88,  the  average  gray  level  along  the  object 
side  of  the  line  (here  the  brighter  side)  is  calculated.  Then 
the  average  gray  level  along  the  object  side  near  each  end  is 
calculated.  A  square  of  4*4  is  used  for  this  purpose.  Let  g 
be  the  average  gray  level  along  the  object  side  and  gen(j  be  the 
average  gray  level  in  the  small  neighborhood  near  the  end.  If 
the  difference 

|g-gendl  >  Threshold 

the  length  is  reduced.  The  new  coordinates  are 


4 


f 

xll=xl-dcos6  x22=x2+dcos0 
yll=yl-dsin0  y22=y2+dsin0 

where  d  is  the  width  of  the  strip  for  calculation  of  average 
gray  level.  This  process  is  continued  for  both  ends  until 

lg~gendl  <  Threshold 

When  this  inequality  is  satisfied  the  corresponding  end  coor¬ 
dinates  are  selected  as  the  new  end  coordinates  for  the  line 
segments . 

The  results  of  this  experiment  for  different  thresholds 
(5,4,3)  are  shown  in  Figures  89-91.  When  the  threshold  is  high 
(5)  only  a  few  changes  occur  in  the  lines.  When  the  threshold 
is  3  or  4  both  the  overshot  lines  and  some  of  the  other  lines 
become  shorter.  This  shows  that  a  unique  threshold  cannot  be 
used  for  all  the  lines.  The  best  result  is  obtained  when  the 
threshold  is  dynamically  set  equal  to  the  standard  deviation  of 
the  gray  level  of  the  object  side  for  each  line  segment.  The 
result  is  shown  in  Figure  92 . 

From  the  experiments  described  in  (a-c)  above  it  appears 
that  no  improvement  results  from  adjustment  of  the  positions  or 
orientations  of  the  line  segments;  but  there  is  some  improvement 
when  the  lengths  are  adjusted  using  a  dynamic  thresholding  pro¬ 
cess  as  described  above.  However,  these  improvements  have  little 


effect  on  the  final  results.  For  example,  the  building  and 
road  segments  with  confidences  of  1,  0.75,  and  0.5  obtained 
after  maximum-gradient  angle  adjustment  are  shown  in  Figures 
93-98.  Analogous  results  for  dynamic-threshold  length  adjust¬ 
ment  are  shown  in  Figures  99-104. 


7.2  Shadow  detection 


One  of  the  features  that  can  be  used  for  verification  of 
the  recognition  of  buildings  is  the  shadow  of  the  building. 

There  are  cases  where  a  parking  lot  can  be  recognized  as  a 
building,  since  they  may  have  the  same  size  or  shape.  It  seems 
that  it  is  possible  to  use  the  shadow  for  further  verification. 
To  study  this,  some  experiments  have  been  performed  using  the 
average  gray  level  within  a  strip  along  each  line  segment  and 
the  angle  of  the  line  segment. 

Referring  to  Figure  105,  each  line  segment  with  angle  0  with 
respect  to  the  x-axis  has  two  sides.  There  are  two  average 
gray  levels  associated  with  each  line  segment.  The  average 
gray  levels  gl  and  g2  are  associated  with  angles  0  and  2ir-0 
respectively. 

Scatter  plots  of  gl  and  g2  with  respect  to  0  are  shown  in 
Figure  106  for  all  of  the  line  segments  and  in  Figure  107  for  the 
line  segments  after  noise  cleaning.  Figure  107  shows  that  at 
dark  gray  levels,  the  population  of  points  for  0>18O°  is  greater 
than  the  population  of  points  for  0<18O°.  This  shows  that  in 
certain  orientations  along  the  line  segments,  there  exist  dark 
shadow  regions . 

To  study  this  effect  quantitatively,  let  us  pick  the  darkest 
P%  of  the  population.  Let 

nl  =  number  of  dark  points  in  the  interval  (0,9+ir) 

and 

n2  =  number  of  dark  points  in  the  interval  (6+u,  0+2n) 


for  0  »  0 , 20 , 40 , . . . , 340 .  The  plots  of  nl/n2  as  a  function  of 
0  for  different  values  of  P  and  for  the  line  segments  after 
and  before  noise  cleaning  are  shown  in  Figure  108  and  Figure  109 
respectively.  These  figures  show  that  there  is  a  peak  around 
180°.  The  peak  is  greater  for  the  segments  after  noise  removal. 
As  expected,  if  P  is  increased  the  peak  becomes  smaller.  This 
effect  was  tested  on  several  other  scenes  and  similar  results 
were  obtained. 

These  results  show  that  shadow  detection  is  most  reliable 
after  noise  segments  have  been  eliminated.  Shadows  could  be 
used  to  verify  the  recognition  of  buildings  (which  may  have 
shadows)  and  roads  (which  should  not) . 
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8.  Concluding  remarks 


The  approach  used  in  this  paper  is  quite  elementary  and 
straightforward.  It  proceeds  in  an  essentially  bottom-up  fashion, 
with  no  provision,  as  yet,  for  top-down  feedback  between  levels, 
and  it  makes  no  use  of  higher-level  information,  e.g.  that 
buildings  are  alongside  roads,  or  that  roads  form  a  connected 
network.  It  uses  less  knowledge  than  the  road-finding  systems 
of  Fischler  et  al.  [10],  and  handles  fewer  types  of  objects  than 
the  aerial  photographic  interpretation  system  of  Nagao  et  al.  [11]. 
Nevertheless,  it  serves  to  illustrate  the  level  of  performance 
that  can  be  achieved  by  a  straightforward  hierarchical  system. 

It  is  expected  that  this  performance  will  continue  to  improve  as 
additional  levels  of  knowledge,  and  a  more  flexible  control 
structure,  are  incorporated  into  the  system. 

It  would  be  of  interest  to  investigate  a  relaxation-like  (or 
MSYS-like)  scheme  for  classifying  the  feature  segments.  Initially, 
each  individual  segment  would  be  probabilistically  classified, 
on  the  basis  of  its  properties,  as  being  (part  of)  a  road, 
building,  etc.  These  probabilities  would  then  be  adjusted 
based  on  their  compatibilities  with  those  of  nearby  or  otherwise 
related  segments.  One  should  not  expect  that  a  simple  algebraic 
formula  can  be  used  to  compute  the  probability  adjustments; 
rather,  they  would  be  computed  by  a  probabilistic  "decision  tree" 
associated  with  each  segment.  This  approach  should  result  in 
a  generally  consistent  classification  (which,  of  course,  may 


still  be  ambiguous) .  If  inconsistencies  remain,  they  would 
probably  reflect  errors  in  the  feature  segment  extraction  pro¬ 
cess,  assuming  that  the  compatibility  models  are  adequate. 
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Geometrical 

conditions 

Case  albl  <  a2b2/m 
2  a1b1  <  a^/m 

albl  <  a2^i^m 
6A^eB 

X  <  X  &  X 


Similarity  conditions 
for  line  a^b^ 

If  a^b^  <  d  no  check 


(a)  x,  <  x  &  x, 
b2  P  bx 


no  check 


x  a.<  x  a./m,  x  b.<x  b„/m 
pi  P  2  *  pi  p  2 


ya2  <  y0 

\  <Xb1-yb1>)'a1 

ya  *  y0 

W  \ 


ya2  *  y0 

V  V\  >  \ 

y  >  y„ 

a2 

x  >  x,  ,y  >  y 
al  °1  1  bl 

y  >  y„ 

^a2  70 

xa  <  *b  .ya  s  yh 
1  1  al  bl 

ya2  =•  y0 

x  s.  x,  ,y  >  y, 
al  bl  al  bl 


Table  3.  Geometrical  and 
for  Case  2. 


If  '3.  i  6  and  x  a  «> 
a  b  pl 

no  check 

else  check  side  1 

If  3  #  0  and  x  b  <  d 

a  b  p  1 

no  check 

else  check  side  2 


check  side  1 


If  9  /  0  and  x  b,<  d 

A  B  p  1 

no  check 

else  check  side  2 


If  0*  +  9n  and  x  a  <  d 
A  B  p  1 

no  check 

else  check  side  1 


check  side  2 


similarity  conditions 


Ceometrical 

conditions 


Case  <  a2b1/m 

^  .  a.b,,  <  a-b„/m 

end  12  1  l 

1  a1b2  <  a1b1/m 

X  <  X  5-  X 

a2  P  a3 

xpal<  Xpa2/m 


x  b_  <  x  b. /m 
p  2  pi 


Similarity  conditions 
for  line  a^b2 

If  alb2  <  d 
no  check. 


no  check 


<b) 

\ 

check  side  1 

\ 

<y»a 

X 

<  X. 

(c) 

*1 

b2 

check  side  1 

\ 

ss 

X 

a. 

‘  V 

If  x  a,<  d  no  check 
P  1 

(d) 

1 

2 

S 

else  check  side  2 

(e) 

X 

a. 

>  xb„ 

If  x  b.<  d  no  check 

P  2 

1 

2 

\ 

b2 

else  check  side  2 

Table 

4. 

Geometrical 

and 

similarity  conditions 

for  case  3: 

end 

1  of  line  A. 

Geometrical 

conditions 

Case 

albl 

<  a2^2^m 

4 

a,  b. 

<  a2^i^m 

end 

1  1 

1 

albl 

<  a^b2/m 

x  a,< 
P~ 

x  a„/m 

P  2 

x  b  < 
P  1 

x  b0/m 

P  2 

(a)  x  <  x  s.  x 
a2  P  « 
If  0_  *  90° 

D 

X.  *  X  <  X, 

P  b0 


else  y  <  y 
Jb_  c 


(b) 


X  -  X, 

al  bl 

ya  >  yb 
al  bl 


(c) 


(d) 


X  <  X, 

al  bl 

*  yh 

1  bl 

>  X, 


'a 

X 


ya  >  yb 
al  b] 


Ce) 


\  <  Yb 

\  £Xb 


Similarity  conditions 
for  line  a^b^ 

If  a^b^  <  d  no  check 


no  check 


check  side  2 


check  side  1 

If  x  b,  <d  no  check 
P  1 

else  check  side  2 

If  x  a,<  d  no  check 
P  1 

else  check  side  1 


Table  6.  Geometrical  and  similarity  conditions 
for  Case  4:  end  1  of  line  A. 
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Geometrical 

Similarity  conditions 

conditions 

for  line  a2b2 

Case 

A 

a2b2  <  a^/m 

If  a2b2  <  d  no  check 

*♦ 

end 

a2b2  <  a2b^/m 

2 

a2b2  <  a1b2/m 

xpa2<  xpal/ra 
xpb2<  xpbl/m 

x  a„*  x  <  x 

(a) 

p  2  p 

no  check 

if  eg  i  90° 


>  A  »  A, 

P  b2 

else  y  s  y  <  y 

bl  0  »2 

(b) 

S 

S 

If  x  a0<  d 
P  2 

else  check 

no  check 

side  1 

X 

*  XL 

If  x  a,<  d 

no  check 

(c> 

a2 

b2 

P  2 

% 

>JS 

else  check 

side  1 

X  < 

!s 

If  x  b_<  d 

no  check 

(d) 

a2 

P  2 

S 

<yh2 

else  check 

side  2 

(e) 

S 

If  x  b_<  d 
P  2 

no  check 

S 

< 

b2 

else  check 

side  2 

Table 

7. 

Geometrical  and 

similarity  conditions 

for  Case  4:  end 

2  of  line  A, 
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(a)  Window  of  the  Occoquan 


Figure  1 


Figure  1 
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Figure  1.  <d)  Gradient  magnitudes  displayed  numerically  on  a  scale  of  0-63  for  a  small  subwindow, 

indicated  by  tick  marks  in  (a):  (dl)  subwindow  gray  levels;  (d2)  originsl  gradient 
magnitudes;  (d3-5)  results  of  three  iterations 
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Figure  1(d),  continued 
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Figure  1.  (e)  Gradient  directions  displayed  in  degrees  for  the  subwindow:  original 
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1.  (e)  Gradient  directions  displayed  in  degrees  for  the  subvindov:  three  iterations 
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Figure  2.  (a)  Edge  components  extracted  from  the  subwindow  in  Figure  1 


Figure  2.  (b)  Line  segments  fitted  to  the  edge  components  in  the  window 

of  Figure  1 


/ 


Figure  3.  Results  of  collinear  linking  (heavy  lines)  for  the  window  of  Figure  1 
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Figure  1*.  (dl-3) 
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Figure  1’.  (d4-5) 


313  133  90  72  79  135  180  198  243  281  308 

108  133  101  63  43  43  233  232  264  276  283 

113  124  0  313  313  308  284  264  266  264  236 

108  O  313  302  294  297  293  278  263  233  231 

90  330  333  319  300  297  293  284  270  239  219 

27  10  18  21  0  326  288  288  270  243  223 

27  43  41  31  13  330  288  270  270  252  223 

27  43  23  10  0  346  304  270  270  270  236 

18  O  O  336  336  333  313  270  270  270  232 

.  43  43  11  336  337  333  333  270  270  270  270 

(el)  63  43  7  333  333  346  333  270  270  223 

43  23  0  337  333  333  313  270  223  270 

270  338  334  0  336  332  313  270  223 

270  297  342  336  0  0  0  133 

270  277  309  347  0  8  27  90  90  90  133 

277  263  297  343  10  33  33  90  104  90  90 

281  239  281  338  13  33  63  98  98  90  82 

304  236  281  297  313  333  90  121  103  90  80 

280  270  291  293  288  270  207  180  133  90  43 

270  276  288  291  280  248  223  223  248  270  270 

270  277  283  293  270  243  232  240  236  270  270 

270  297  288  270  270  223  223  239  260  270  270 

63  43  43  223  223  243  232  232  270 

34  34  27  43  180  223  223  270  223  270 


322  313  315  180  180  190  207  252  288  315  45  45  45 

304  0  90  124  133  133  133  313  297  243  O  0 

236  180  117  146  146  146  133  O  297  232  243  315  333 

218  214  243  223  223  223  243  313  313  270  236  270  333 

219  239  260  260  248  248  260  281  297  270  236  243  333 

223  248  270  270  232  246  249  270  2BI  270  214  207  90 

231  236  270  270  232  246  243  232  236  223  180  133  117 
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Figure  1'.  (e2-4) 
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(a) 


Figure  2'.  Analogous  to  Figure  2  for  Che  second  (sub)wlndow 


Figure  10.  Examples  of  geometrically  compatible  candidate  pairs. 


J 


Figure  18.  Calculation  of  the  distances  between 
two  lines. 
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b)  A  house  c)  An  intersection 

Figure  19.  Examples  of  closed  groups. 
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Figure  20.  Examples  of  semiclosed  groups. 
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Figure  21 .  Examples  of  possible  cases  of  roads  and  buildings 


Figure  22.  Case  (a)  of  two  compatible 
lines . 


Figure  23.  Case  (b)  of  two  compatible 
lines . 


Figure  24.  Case  (c)  of  two  compatible 
lines. 


c)  Merging  road. 
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d)  Road  with  merging  edges 
due  to  cutoff. 


Figure  25.  Examples  of  possible  roads  with  high  confidence. 


Figure  26.  Example  of  a  possible  building  connected  to  a  road 
via  a  driveway  (semiclosed  within  a  group) . 


Figure  27.  A  special  case  where  a  line  such  as  A  has  no  anti-parallel 
but  both  of  its  compatible  neighbors  are  roads  with  high 
confidence. 


Figure  36.  Roads  with  probability  ^0.75. 
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Figure  44.  Ant  ip.irn]  lei  lines 


Figure  53.  Line  segments  whose  probabilities  of 
being  a  piece  of  road  or  building 


Figure  55.  Anti  para 


igure  64.  Line  segments  whose  probability  of  be 
a  piece  of  road  or  building  are  nonze 


Figure  68.  Buildings  with  probability  -0.75  or 


Figure  74.  High  confidence  buildings 


Figure  75.  High  confidence  roads 


Figure  76.  Buildings  with  probability  20.75 


Figure  77.  Roads  with  ptobability  20.75  or  * 


Figure  84.  First  translation  then  rotation  and  relocating  at  the 
maximum  gradient  position. 
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Figure  86.  First  rotation  then  translation  and  relocating  at  the 
maximum  gradient  position. 


Figure  87.  First  rotation  then  translation  and  relocating  at  the 
minimum  standard  deviation  position. 


Figure  88.  Length  adjustment 


Figure  90.  Threshold  ■  4  in  length  adjustment 


Figure  91.  Threshold  =  3  in  length  adjustment. 


Figure  92.  Length  adjustment  with  threshold  « 

standard  deviation  of  the  gray  level 
on  the  object  side  of  the  line  segment 


Figure  97.  Buildings  with  confidence  .5  after  maximum  gradient  angle 
adjustment. 


Figure  98.  Roads  with  confidence  .5  after  maximum  gradient  angle 
adjustments 


I _ — - 3 

Figure  99.  Buildings  with  confidence  1  after  dynamic-threshold 
length  adjustment. 


Figure  100.  Roads  with  confidence  1  after  dynamic- threshold 
length  adjustment. 


Figure  101.  Buildings  with  confidence  .75  after  dynamic-threshold 
length  adjustment. 


Figure  102.  Roada  with  confidence  .75  after  dynamic-threshold 
length  adjustment. 


Figure  103.  Buildings  with  confidence  .5  after  dynamic-threshold 
length  adjustment. 


Figure  104.  Roads  with  confidence  .5  after  dynamic-threshold 
length  adjustment. 
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